Ground-state energy fluctuations in the Sherrington-Kirkpatrick model 
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The probability distribution function (PDF) of the ground-state energy in the Sherrington- 
Kirkpatrick spin-glass model is numerically determined by collecting a large statistical sample of 
ground states, computed using a genetic algorithm. It is shown that the standard deviation of the 
ground-state energy per spin scales with the number of spins, A'^, as N~'' with p ~ 0.765, but the 
value p = 3/4 is also compatible with the data, while the previously proposed value p = 5/6 is 
ruled out. The PDF satisfies finite-size scaling with a non-Gaussian asymptotic PDF, which can be 
fitted remarkably well by the Gumbel distribution for the m-th smallest element in a set of random 
variables, with m ~ 6. 

PACS numbers: 75.50.Lk, 75.10.Hk 
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Models with quenched disorder describe a wide class 
of systems in physics and other fields^ '^. In thermal sys- 
tems, the effects of disorder are especially important at 
low temperatures, where the physics is dominated by the 
low-energy states. These states are also of direct inter- 
est in many applications, for instance to combinatorial 
search problems!. Understanding the properties of the 
low-energy states is therefore a central task. 

In this context, an important aspect concerns the sta- 
tistical fluctuations of the energy of the low-lying states 
with respect to the disorder. Consider a system described 
by an energy function Hn{S,3), where S represents N 
degrees of freedom and J a set of quenched random vari- 
ables signifying the disorder. The ground-state energy 
per degree of freedom, cn = ./V~^ mins i?A'(S, J), when 
considered as a function of J, is also random variable, and 
typically one would like to know its mean (eAr), standard 
deviation = — (cAr)^)^/^, and possibly its entire 

PDF, pAf(eAr). In the thermodynamic limit, N ^ oo, 
usually the properties of extensivity {{cn) sq, with 
eo a quantity of order one) and self-averaging (crjv 0) 
hold, so one simply has Pn{x) — > 5{x — eo). Thus, the 
interesting question is to determine the finite-iV scaling 
behavior. More precisely, one may ask for example: 

(i) How does (cat) scale with A^? 

{a) How does (Tat scale with A^? 

{Hi) Given the natural scaling variable yiq = [cn ^ 
(eAr))/crjv, does its PDF pNiVN) converge for large A^ to 
a nontrivial asymptotic PDF, i5oo(2/Jv)? 

To leading order, we expect (bn) — cq + bN~'^ and 
(Tat ~ A^"'', so (i) and (ii) amount to determine the 
exponents lu and p. Question (iii) amounts to determine 
whether the scaling relation 



PN[eN) = Poo 



(1) 



holds for large A^, and the shape oipoo{x). The answer 
to (ii) and (iii) is simple for systems with short-range in- 
teractions, where the volume can be subdivided so that 
ba/ is the sum of 0{N) nearly independent contributions. 



For the central limit theorem, then, ctat ~ N~^/^ (as rig- 
orously proven for short-range spin glassed) and Poo (x) 
is a Gaussian for moderate values of x (we will not be 
concerned with large deviations here). For sufRciently 
long interaction range, in general one has p ^ 1/2 and a 
non-Gaussian poc (x)^- 

In this paper, the questions above are addressed nu- 
merically for the infinite-range Sherrington-Kirkpatrick 
(SK) spin-glass model^. Much is known about 
this model, following Parisi's replica-symmetry-breaking 
(RSB) solution^'^, but many issues remain open, finite- 
size scaling being a prominent one. The exponents lo and 
p remain unknown analytically, while previous numerical 
work indicates uj ~ 2/2^'^'^ an p ~ 3/42iiS. Determining 
the full ground-state energy PDF is a much more chal- 
lenging task, which so far has received limited attention^. 
Here, we will address these issues with a much higher 
statistics than in previous studies. 

The interest of this problem lies also in its 
relationshipii with extreme value statistic^. The goal of 
extreme value statistics is to determine whether the PDF 
of the m-th smallest value X in a set of random variables 
Xi, . . . , Xm (the energy levels in our case) approaches a 
scaling form pm{X) = \/bMPoo[{.X - aM)/bM] for large 
M, with suitable um, bM- The case of independent, iden- 
tically distributed (i.i.d.) Xi's is well understoodi^: if 
scaling holds, Poo{x) is one of three universal distribu- 
tions, depending on the PDF of the X^'s. If the latter is 
unbounded and decays faster than a power law for large 
\Xi\, then Poo (a:) is the Gumbel PDF (defined below). An 
example of a disordered system with i.i.d. energy levels 
is the Random Energy ModelM, but in general the lev- 
els are correlated, and this case is much less understood 
(an exception is when e^v is the sum of spatially uncorre- 
lated variables, as mentioned above). The Gumbel form 
is preserved for short-range correlations and violated for 
sufficiently long-range correlationsiiii^. It is therefore in- 
teresting to ask if it applies, at least approximately, to the 
SK model, where full RSB leads to hierarchically corre- 
lated energy levels (see, however, Ref.f^for a model with 
hierarchical correlations giving a non- universal PDF). 
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Numerical details - We study the standard SK model 
with energy function 

Hn — — ^ JijSiSj (2) 

where the S'i's are N Ising spins {Si — ±1) and the Jij's 
are i.i.d. random variables drawn from a Gaussian PDF 
with zero mean and variance The sizes studied are 

N = 19, 39, 59, 99, and 199 with, respectively, 250000, 
250000, 180000, 120000, and 64000 independent reahza- 
tions of the disorder (samples). The ground state of each 
sample was determined using a genetic algorithmi^*i^. 
The l-th order cumulants of PAr(eAr), denoted by ki^N, 
and their statistical errors were then estimated with a 
bootstrap methodic up to / = 5. With large statistics, 
it is especially important to control the systematic errors 
due to occasionally missing the ground state. This was 
done by performing much longer runs for a fraction of 
the samples, checking that the change in the cumulants 
was smaller than the desired statistical error. 

Scaling of the mean and standard deviation - Previ- 
ous numerical studies indicate a value w ~ 2/3 for both 
the SK modcl^'^ and diluted spin glassesiSiSiiS. The an- 
alytical result a; = 2/3 was obtained for the finite-size 
scaling of the internal energy near Tc and the Almeida- 
Thouless lineiP, but no result is available deep in the 
ordered phase. Our data for {e^ — eo)iV^/'^, using the 
exact Parisi result^ cq — —0.7633 . . ., are shown in the 
inset of Fig. 1. The small residual dependence on N'^'^ 
either indicates that ui is greater than 2/3 or, if a; = 2/3, 
that the data are accurate enough to resolve subleading 
corrections. A fit with (ejv) = —0.7633 + hN^'^ gives 
LO = 0.673 ± 0.002 (x^ = 11.2, ndf = 3, ndf being the 
number of degrees of freedom), where the error gives the 
range for which the goodness-of-fit Q is larger than 10~^. 
A fit with w = 2/3 (leaving b as the only free parameter) 
gives Q < 10~^^, which is clearly not acceptable. Nev- 
ertheless, since corrections of just a few percent could 
accommodate the value oj = 2/3 (note the vertical scale 
in the inset of Fig. 1), this value cannot be ruled out. Fits 
with corrections (for example (cat — eo}iV" = b + cN~'^^ 
with fixed eg and lj) are not conclusive since the correc- 
tions are small and thus the parameter range is large. 

Turning now to the fluctuations, in the replica formal- 
ism one can write the cumulant generating function of 
the (quenched) free-energy as the annealed free energy of 
n replicas, f{n). Crisanti et al»2i argued that if the first 
nonlinear term in the small-n expansion of f{n) is (in 
the thermodynamic limit) then p = 1 — 1/i. Kondor^^ 
found f{n) = nf — cn^ from the "truncated model", 
which would imply p — 5/6. Recently, Aspelmeier and 
Moored and De Dominicis and Di Francesco24 found a 
higher free-energy (hence better) solution f(n) = nf, 
from which the conclusion p = 5/6 no longer follows, and 
Refs.i^EsI gave qualitative arguments indicating p — 3/4. 
On the numerical side, Cabasino et alm^ found a result 
compatible with p = 3/4, but with large statistical errors, 
and Bouchaud et ali^ found p ~ 0.76, also compatible 
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FIG. 1: Standard deviation of the ground-state energy per 
spin as a function of the system size. The lines represent the 
power-law ajv = aN~'' for three values of p. Inset: finite-size 
deviation of the mean from the RSB result eo = -0.7633. 



with 3/4, but they could not rule out p = 5/6. 

Our numerical data for crjv are displayed in Fig. 1, mul- 
tiplied by N^/'^ to stress that crjv decays faster with N 
than in short-range models. An exponent p = 3/A follows 
reasonably well the data, but deviations can be noticed. 
These are seen more clearly in the plot of N^/'^un in 
Fig. 2(a). Here the curvature in the data demonstrates 
the presence of subleading corrections. The dashed line 
represents a power law fit o-jy — aN~P for N > 59, which 
gives p = 0.765 ± 0.01 (x^ — 3.93, ndf = 1), in agreement 
with p = 3/4: (the error corresponds again to Q > 10~^). 
However, the decreasing trend for large N— and the neg- 
ative curvature suggest that p may in fact be greater 
than 3/4. As for the mean, fits with correction terms 
(for fixed p) are not very illuminating. Fig. 1 also shows 
that p = 5/6 clearly does not fit the data, as seen also in 
Fig. 2(b) where N^/^un is far from constant. Since the 
sizes considered are already well in the scaling regime (at 
least as far as Eq.Q is concerned, see below), crossover 
to a constant for larger TV is rather unlikely, hence we 
conclude that p = 5/6 is ruled out. Finally, ii aM ^ N~p 
and Eq.ljlJ holds, then ki^N ~ N~'-p. Figs. 2(c) and 2(d) 
show that also for / = 3,4 the data agree with p ~ 3/4 
but not with p = 5/6 (note that the statistical error is 
much larger than that of un)- 

Scaling of the PDF - Scaling plots of pn{gm) accord- 
ing to Eq.QJ are shown in Fig. 3 and, on a logarithmic 
scale. Fig. 4. The data collapse is remarkably good, in- 
dicating that we are already well in the scaling regime. 
Comparison with a Gaussian PDF, represented by the 
dashed lines in Figs. 3 and 4, clearly indicates a non- 
Gaussian behavior. Table I displays the scaled cumulants 
/c/jv = ki,pf/apf for ^ = 3,4, 5 (since k2^N = 1 by defini- 
tion, ks^N is the skewness and k^^pf the kurtosis of pn)- 
the cumulants are independent of N within the errors. 
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FIG. 2: Plots of crjviV for p = 3/4 (a) and p = 5/6 (b), and 
of ki.NN'" for p = 3/4, I = 3 (c) and p = 3/4, « = 4 (d). 
The dashed hne in (a) is the best fit crjv = aN~'' for > 59, 
giving p = 0.765. The dotted hnes in (c) and (d) represent 
power laws A*'^''' with p — 5/6. 



again strongly supporting scaling (small deviations exist 
for = 19 and I — 3, 4, presumably due to corrections 
to scaling) . Note that scaling of the PDF is independent 
of the values of uj and p. 

Next, we compare the scaled PDF to known theoretical 
distributions. The Gumbel PDF for the m-th smallest in 
a set of i.i.d. random variables has the form.l^*2& 



i{x) = w exp 



u X ~ u 
m exp 



(3) 



where u and v are rescaling parameters and w a normal- 
ization constant. To compare this to our data, we im- 
pose zero mean and unit variance which, together with 
normalization, fixes u, v, and w as a function of m. Ex- 
pressions for the cumulants of gm{x) are easily obtained. 
These are decreasing functions of m, in absolute value, 
and vanish for large m, thus gm provides an interpolation 
between the standard Gumbel (m = 1) and a Gaussian 
PDF (m = oo). As shown in Table I, the cumulants 
are fitted well for m = 6 ± 0.3 (k^^N shows small devi- 
ations from the < 39 data, possibly an effect of cor- 
rections to scaling). Table I also shows that m = 7r/2 
(see below) is far from agreeing with the data, hence 
even more so is m = 1, as also noted in Ref. H- This 
shows that the correlations in the energy levels give rise 
to a more Gaussian-like PDF with respect to the uncor- 
related (to — 1) case. The PDF gQ{x) is displayed with 
solid lines in Figs. 3 and 4, and the corresponding cumu- 
lative distribution in the inset of Fig. 3: the agreement 
with the data is excellent everywhere. Although it is 
not clear why a Gumbel distribution with m ^ 1 should 
work here, gQ{x) can certainly be used to accurately rep- 
resent the true PDF up to several standard deviations. 
It would be interesting to reach higher statistics to check 
whether the agreement breaks down. Incidentally, the 
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FIG. 3: Scaling plot of the ground-state energy PDF. The 
solid line is the Gumbel PDF with m = 6 (it = 0.2011219, v = 
2.348408, w = 165.5589). The dotted line is the Tracy- Widom 
PDF with /3 = 1. The dashed Une is a Gaussian PDF. All 
PDF's are normalized to one and have zero mean and unit 
variance. The inset shows a zoom near the origin. 



Gumbel distribution with a non-integer value m — ■n/2 
has been conjectured to describeSl, at least to a good ap- 
proximation, the PDF of spatially averaged quantities in 
many correlated systems, even when no extreme value is 
apparently involved. A modified Gumbel form with non- 
integer TO was also used to describe the order-parameter 
PDF in three-dimensional spin glasses^. 

Another example of extreme value of correlated ran- 
dom variables is the smallest eigenvalue. Am, of an 
M X M random matrix. For three well-known ensem- 
bles, the scahng PDF of \m is the Tracy- Widom (TW) 
distribution'^^, fpix), with /3 a parameter dependent on 
the ensemble. We tested it against our data finding a 
poor agreement, although better than for gi{x). Table I 
shows that the cumulants for P — 1 (and thus for (3 — 2), 
computed from the tabulated fp{x)^, are well outside 
the statistical errors. The PDF fi{x) is displayed with 
dotted lines in Figs. 3 and 4: one can see small devia- 
tions from the data for small x and large deviations in 
the tails. 

In conclusion, we presented accurate numerical data 
consistent with w = 2/3 and p = 3/4 when considering 
subleading corrections, although both exponents may be 
in fact slightly larger than these values. The PDF of the 
ground-state energy satisfies finite-size scaling with an 
asymptotic PDF empirically well described by a Gumbel 
distribution. 

After this work was virtually finished, we learned that 
PAr(eAr) was also studied numerically in Ref. l3ll 
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FIG. 4: Same as Fig. 01 but on a semi-logarithmic scale. In- 
set: scaling plot of the cumulative distribution (5]v(e]v) — 
P_I^Pn{x) dx for iV = 19, 39, 59, 99, 199, and of the Gumbel 
cumulative distribution for m = 6. The curves all fall on top 
of each other within the line thickness. 
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19 


467 + 007 


0.42 ± 0.02 


46 + 07 


39 


0.422 ± 0.007 


0.35 ± 0.02 


0.31 ± 0.05 


59 


0.413 ± 0.008 


0.35 ± 0.02 


0.32 ± 0.07 


99 


0.420 ± 0.010 


0.37 ± 0.03 


0.40 ± 0.08 


199 


0.409 ± 0.015 


0.41 ± 0.04 


0.68 ± 0.15 




0.42468 


0.35346 


0.4441 


9tt/2 


0.89373 


1.53674 


3.8403 


h 


0.2935 


0.16524 


0.1024 


h 


0.2241 


0.09345 


0.0386 



TABLE 1: Cumulants of the scaled PDF pjv(j/jv) for various 
values of A'^, compared with the cumulants of the theoretical 
PDF's gm{x) (Gumbel distribution for m-th largest extreme) 
and fj3{x) (Tracy- Widom distribution). 
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